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METHOD AND SYSTEM FOR COMPOSITE GATING USING 

MULTIPLE INPUTS 

BACKGROUND OF THE INVENTION 

The present technique relates generally to the measurement of the overall 
motion undergone by an organ. More specifically, the present technique relates to 
measuring the motion of one or more internal organs via one or more external sensors 
and/or via data acquired from a medical imaging system to determine the overall 
motion of at least one of the internal organs. 

In the medical field, it is often desirable to generate images of the internal 
organs or structure of a patient for diagnosis or examination. For example, magnetic 
resonance imaging and computed tomography are two well known examples of 
imaging modalities used to generate images of the internal organs or structures of a 
patient. The reconstructed images, however, may be flawed or contain artifacts due to 
the motion of internal organs, such as the heart, lungs, diaphragm, stomach, and so 
forth. In particular, if the imaged region has undergone motion during the imaging 
process, various motion related artifacts or discontinuities may be present in the 
reconstructed image. 

To reduce or eliminate the effects of internal motion, gating techniques may be 
employed which utilize information about organ motion to minimize the effect of the 
organ motion during imaging. Gating techniques that use organ motion information to 
time the acquisition of imaging data are known as prospective gating techniques. 
Conversely, those that use organ motion information to time the acquisition of 
imaging data are known as retrospective gating techniques. 

The organ motion information used for gating typically represents the 
contractions, convulsions, or extensions of the organ of interest. However, due to the 
spatial relationship of the various internal organs, many of which undergo some form 
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of motion, gating techniques that address only a portion of the overall motion of an 
organ may produce images that still possess motion artifacts. For example, the 
rhythmic contractions of the heart, which may be determined using various techniques 
such as electrocardiography (ECG) or mechanical cardiography, may be used in gating 
5 the acquisition and/or reconstruction of cardiac image data. Measuring the 

contractions of the heart, however, only partially describes the overall motion of the 
heart. The motion of other organs, such as the respiratory motion of the lungs or 
diaphragm, may also be moving the heart relative to the viewer or imaging scanner. 
Consequently, knowing the cardiac motion attributable to the heart alone, such as the 
10 phase of cardiac motion, may not be sufficient to fully describe the overall motion of 

the heart relative to the imaging scanner, which may reduce the benefits obtainable by 
gating techniques. It may, therefore, be desirable to more fully characterize the 
motion undergone by an internal organ during imaging for purposes of gating or 
motion correction. 

15 

BRIEF DESCRIPTION OF THE INVENTION 

The present invention is directed to a technique for detecting and/or measuring 
the overall motion of one or more organs of interest. The overall motion of the organ 
or organs of interest may be determined from a set of multi-input motion data. The 

20 multi-input motion data may comprise motion data for the organ of interest derived 

from multiple sources, such as sensor-based or image-data based sources. The multi- 
input motion data may also comprise motion data for proximate organs, which 
contribute to the overall motion of the organ of interest, derived from one or more 
sources, including possibly a source used to measure the motion of the organ of 

25 interest. The multi-input nature of the multi-input motion data, therefore, may 

describe either the presence of motion data for more than one organ, the presence of 
multiple sources of motion data for an organ, or the presence of both multi-input and 
multi-source motion data. 

30 The multi-input motion data may be used to determine one or more quiescent 

periods for the organ of interest corresponding to an interval of minimal absolute 



2 



132958XX-D 

motion for the organ. A quiescent period may be used to determine gating points that 
may used to gate the image data, prospectively and/or retrospectively, to reduce 
motion artifacts in the resulting image. In addition, a quiescent period may be used to 
derive one or more motion compensation factors which may be applied during image 
5 processing to reduce motion artifacts. Alternatively, another period of motion for the 

organ may be derived from the multi-input motion data, such as a particular phase of 
motion associated with a motion cycle or period, such as the initiation of cardiac 
contraction. 

10 In accordance with one aspect of the present invention, a technique is provided 

for imaging an organ. In view of this aspect, a set of motion data for two or more organs 
may be acquired from at least one of one or more types of electrical sensors and one or 
more types of non-electrical sensors. The set of motion data may be processed to extract 
two or more prospective gating points and two or more retrospective gating points for an 

15 organ of interest. A set of image data representative of the organ of interest may be 

acquired using the two or more prospective gating points. A portion of the set of image 
data may be processed based upon the two or more retrospective gating points. 

In accordance with another aspect of the present invention, a technique is 
20 provided for imaging an organ. In view of this aspect, a set of motion data for two or 

more organs may be acquired from at least one of one or more types of electrical 
sensors and one or more types of non-electrical sensors. The set of motion data may 
be processed to extract two or more prospective gating points and two or more 
retrospective gating points for an organ of interest. A set of image data representative 
25 of the organ of interest may be acquired using the two or more prospective gating points. 

The set of image data may be reconstructed to generate a set of reconstructed data. A 
portion of the set of reconstructed data may be processed based upon the two or more 
retrospective gating points. 

30 In accordance with one aspect of the present invention, a technique is provided 

for imaging an organ. In view of this aspect, a set of motion data for an organ of interest 
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may be acquired from at least one or more non-electrical sensors. The set of motion 
data may be processed to extract two or more prospective gating points and two or more 
retrospective gating points for the organ of interest. A set of image data representative 
of the organ of interest may be acquired using the two or more prospective gating points. 
5 A portion of the set of image data may be processed based upon the two or more 

retrospective gating points. 

In accordance with another aspect of the present invention, a technique is 
provided for imaging an organ. In view of this aspect, a set of motion data for an 

10 organ of interest may be acquired from at least one or more non-electrical sensors. 

The set of motion data may be processed to extract two or more prospective gating 
points and two or more retrospective gating points for an organ of interest. A set of 
image data representative of the organ of interest may be acquired using the two or more 
prospective gating points. The set of image data may be reconstructed to generate a set 

15 of reconstructed data. A portion of the set of reconstructed data may be processed based 

upon the two or more retrospective gating points. 

In accordance with one aspect of the present invention, a technique is provided 
for imaging an organ. In view of this aspect, a set of motion data for a respiratory organ 

20 of interest may be acquired from at least one or more electrical sensors. The set of 

motion data may be processed to extract two or more prospective gating points and two 
or more retrospective gating points for the organ of interest. A set of image data 
representative of the organ of interest may be acquired using the two or more 
prospective gating points. A portion of the set of image data may be processed based 

25 upon the two or more retrospective gating points. 

In accordance with another aspect of the present invention, a technique is 
provided for imaging an organ. In view of this aspect, a set of motion data for a 
respiratory organ of interest may be acquired from at least one or more electrical 
30 sensors. The set of motion data may be processed to extract two or more prospective 

gating points and two or more retrospective gating points for an organ of interest. A 
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set of image data representative of the organ of interest may be acquired using the two or 
more prospective gating points. The set of image data may be reconstructed to generate 
a set of reconstructed data. A portion of the set of reconstructed data may be processed 
based upon the two or more retrospective gating points. 

In accordance with one aspect of the present invention, a technique is provided 
for imaging an organ. In view of this aspect, a set of motion data for an organ of interest 
may be acquired from one or more electrical sensors and one or more non-electrical 
sensors. The set of motion data may be processed to extract two or more prospective 
gating points and two or more retrospective gating points for the organ of interest. A set 
of image data representative of the organ of interest may be acquired using the two or 
more prospective gating points. A portion of the set of image data may be processed 
based upon the two or more retrospective gating points. 

In accordance with another aspect of the present invention, a technique is 
provided for imaging an organ. In view of this aspect, a set of motion data for an 
organ of interest may be acquired from one or more electrical sensors and one or more 
non-electrical sensors. The set of motion data may be processed to extract two or 
more prospective gating points and two or more retrospective gating points for an 
organ of interest. A set of image data representative of the organ of interest may be 
acquired using the two or more prospective gating points. The set of image data may be 
reconstructed to generate a set of reconstructed data. A portion of the set of 
reconstructed data may be processed based upon the two or more retrospective gating 
points. 

In accordance with one aspect of the present invention, a technique is provided 
for imaging an organ. In view of this aspect, a set of motion data for one or more organs 
may be acquired from at least one of one or more types of electrical sensors and one or 
more types of non-electrical sensors. The set of motion data may be processed to extract 
two or more prospective gating points and two or more retrospective gating points for an 
organ of interest. A set of image data representative of the organ of interest may be 
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acquired using the two or more prospective gating points. A portion of the set of image 
data may be processed based upon the two or more retrospective gating points. Motion 
in the portion of the set of image data may be compensated based upon a set of motion 
compensation factors derived from one or more pre-acquisition images 

5 

In accordance with another aspect of the present invention, a technique is 
provided for imaging an organ. In view of this aspect, a set of motion data for one or 
more organs may be acquired from at least one of one or more types of electrical 
sensors and one or more types of non-electrical sensors. The set of motion data may 

10 be processed to extract two or more prospective gating points and two or more 

retrospective gating points for an organ of interest. A set of image data representative 
of the organ of interest may be acquired using the two or more prospective gating points. 
The set of image data may be reconstructed to generate a set of reconstructed data. A 
portion of the set of reconstructed data may be processed based upon the two or more 

15 retrospective gating points. Motion in the portion of the set of reconstructed data may 

be compensated based upon a set of motion compensation factors derived from one or 
more pre-acquisition images. Systems and computer programs that afford functionality 
of the type defined by these methods are also provided by the present technique. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other advantages and features of the invention will become 
apparent upon reading the following detailed description and upon reference to the 
drawings in which: 

25 Fig. 1 is a general diagrammatical representation of certain functional 

components of an exemplary generic imaging system capable of gating and/or motion 
correction via the present technique; 

Fig. 2 is a flowchart depicting the acquisition of data representing the motion 
30 more than one organ, in accordance with the present technique; 
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Fig. 3 is an exemplary representation of a multi-input motion data set and of a 
common gating period derived from the multi-input motion data; 

Fig. 4 is a flowchart depicting the determination of gating points and/or 
5 motion compensation factors from a set of multi-input motion data; 

Fig. 5 is a flowchart depicting prospective gating, in accordance with the 
present technique; 

10 Fig. 6 is a flowchart depicting retrospective gating, in accordance with the 

present technique; 

Fig. 7 is a flowchart depicting prospective gating followed by retrospective 
gating, in accordance with the present technique; and 

15 

Fig. 8 is a flowchart depicting composite image acquisition and processing, in 
accordance with the present technique. 

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS 

20 In the field of medical imaging, it is often desirable to characterize the motion 

of an imaged organ so that the motion may be accounted for to improve image quality. 
Measures of the muscular activity of the organ of interest, however, may characterize 
only a portion of the overall motion of the organ relative to the viewer or imaging 
scanner. In particular, the overall motion may consist of not only the muscular 

25 contractions of the organ of interest itself, i.e., the inherent motion, but also motion 

attributable to the movement of proximate organs. For example, the overall motion of 
the heart may consist of not only the muscular contractions of the heart but also the 
movement of the lungs, the movement of the diaphragm, or other proximate muscular 
contractions, voluntary and/or involuntary, of the patient's body. Therefore, in the 

30 example of cardiac imaging, it may be desirable to characterize the overall motion of 
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the heart relative to the imager, not simply the motion attributable to the contraction of 
the heart itself. 

For example, the motion of the organ to be imaged may be used in image 
acquisition or reconstruction techniques that rely on data gating. In general, data 
gating techniques acquire image data (prospective gating) or select acquired image 
data (retrospective gating) based upon the motion of the organ being imaged, allowing 
image data to be acquired or selected at or near the desired phase of motion. The 
acquired or selected image data may then be reconstructed to form images that have 
fewer artifacts attributable to organ motion. 

However, to the extent that the gating process relies only upon information 
related to the muscular contraction or movement of the organ of interest, the process 
may not account for the motion component attributable to other proximate organs. In 
other words, the overall motion of the organ of interest may not be accounted for by 
looking at the muscular activity of the organ of interest alone. Failure to account for 
the overall motion of the organ of interest during gating may result in reconstructed 
images containing motion related artifacts. 

One way in which the overall motion of the organ of interest may be 
determined is to employ one or more motion determination techniques capable of 
determining the motion of the organ of interest more precisely and/or to determine the 
motion of one or more proximate organs that contribute to the overall motion of the 
organ of interest. These multiple inputs of motion data may be analyzed, such as by 
various combination and/or separation techniques, to determine one or more quiescent 
periods for the organ of interest in which the overall motion of the organ is minimized 
relative to the imager. The quiescent periods may then be used to gate the imaging 
process, either prospectively or retrospectively, to generate images of the organ of 
interest with reduced or minimal motion artifacts. 
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An exemplary imaging system 10 capable of operating in accordance with the 
present technique is depicted in Fig. 1. Generally, the imaging system 10 includes 
some type of imager 12 that detects signals and converts the signals to useful data. As 
described more fully below, the imager 12 may operate in accordance with various 
5 physical principals for creating the image data. In general, however, the imager 12 

creates image data indicative of the region of interest in a patient 14, either in a 
conventional support, such as photographic film, or in a digital medium. 

The imager 12 operates under the control of system control circuitry 16. The 
10 system control circuitry 16 may include a wide range of circuits, such as radiation 

source control circuits, timing circuits, circuits for coordinating data acquisition in 
conjunction with patient or table movements, circuits for controlling the position of 
radiation sources and detectors, and so forth. In the present context, the system 
control circuitry 16 may also include memory elements, such as magnetic or optical 
15 storage media, for storing programs and routines executed by the system control 

circuitry 16 or by associated components of the system 10. The stored programs or 
routines may include programs or routines for performing all or part of the present 
technique. 

20 Image data or signals acquired by the imager 12 may be processed by the 

imager 12, such as for conversion to digital values, and provided to data acquisition 
circuitry 18. The data acquisition circuitry 18 may perform a wide range of processing 
functions, such as adjustment of digital dynamic ranges, smoothing or sharpening of 
data, as well as compiling of data streams and files, where desired. In situations 

25 where pre-acquisition image data, such as Navigator pulses in magnetic resonance 

imaging (MRI), are acquired, the data acquisition circuitry 1 8 may provide image data 
to the system control circuitry 16 for prospective gating. 

The data acquisition circuitry 18 may also transfer acquisition image data to 
30 data processing circuitry 20, where additional processing and analysis are performed. 

The data processing circuitry 20 may perform substantial analyses of image data, 
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including ordering, sharpening, smoothing, feature recognition, and so forth. In 
addition, the data processing circuitry 20 may receive motion data for one or more 
organs from one or more sensor-based motion detection systems 34, as discussed in 
detail below. Based on image-based and/or sensor-based motion data, gating and/or 
5 motion compensation may be facilitated by the data processing circuitry 20, such as by 

determining gating intervals and/or motion corrections factors that may be provided to 
the system control circuitry 16 and/or operator workstation 22. The processed image 
data may be stored in short or long term storage devices, such as picture archiving 
communication systems, which may be located within or remote from the imaging 
10 system 10 and/or reconstructed and displayed for an operator, such as at the operator 

workstation 22. 

In addition to displaying the reconstructed image, the operator workstation 22 
may control the above-described operations and functions of the imaging system 10, 

15 typically via an interface with the system control circuitry 16. The operator 

workstation 22 may include one or more processor-based components, such as general 
purpose or application specific computers 24. In addition to the processor-based 
components, the operator workstation 22 may include various memory and/or storage 
components including magnetic and optical mass storage devices, internal memory, 

20 such as RAM chips. The memory and/or storage components may be used for 

storing programs and routines for performing the techniques described herein that are 
executed by the operator workstation 22 or by associated components of the system 
10. Alternatively, the programs and routines may be stored on a computer accessible 
storage and/or memory remote from the operator workstation 22 but accessible by 

25 network and/or communication interfaces present on the operator workstation 22. 

The operator workstation 22 may also comprise various input/output (I/O) 
interfaces, as well as various network or communication interfaces. The various I/O 
interfaces may allow communication with user interface devices, such as a display 26, 
30 keyboard 28, mouse 30, and printer 32, that may be used for viewing and inputting 

configuration information and/or for operating the imaging system 10. The various 
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network and communication interfaces may allow connection to both local and wide 
area intranets and storage networks as well as the Internet. The various I/O and 
communication interfaces may utilize wires, lines, or suitable wireless interfaces, as 
appropriate or desired. 

As one of ordinary skill in the art will appreciate, more than a single operator 
workstation 22 may be provided for an imaging system 10. For example, an imaging 
scanner or station may include an operator workstation 22 which permits regulation of 
the parameters involved in the image data acquisition procedure, whereas a different 
operator workstation 22 may be provided for manipulating, enhancing, and viewing 
results and reconstructed images. 

The motion of one or more organs of interest may be detected and/or measured 
in a variety of ways and provided to the imaging system 10. As one of ordinary skill 
in the art will readily apprehend, the type of data gating desired may determine the 
type of motion data acquired. In some cases, the motion data of interest may be 
derived using the image scanner 12 itself. For example, pre-acquisition imaging 
techniques, such as navigator pulses in MR systems, -scout images in CT systems or 
fluoroscopic images in other generalized X-ray applications, may be employed to 
determine the motion of the organ of interest or other organs proximate to the organ of 
interest. In other cases, motion data for the organ or organs of interest may be 
determined from the acquisition image data in the acquired, i.e., unreconstructed, 
domain and/or in the reconstructed domain. Use of the imaging system 10 to acquire 
motion data, both in the pre-acquisition and the acquisition context, are examples of 
image-based motion detection and measurement, as discussed in detail herein. 

In some instances, however, sensor-based motion determination techniques 
may be employed. In these instances, the exemplary imaging system 10 may include 
or may be in communication with one or more sensor-based motion determination 
systems 34. The sensor-based motion determination systems 34 typically comprise 
one or more sensors 36 in the form of a pad or contact that may be disposed on skin 
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surface of the patient 14. The contact area of a sensor 36 may vary in size from 
micrometers to centimeters in diameter and height. The size selected is usually based 
on an application. Similarly, the number of sensors 36 used may depend on the 
application. 

5 

When disposed on the patient 14, the sensor 36 may detect and/or measure 
some metric or parameter of interest, such as an electrical or mechanical event, that 
may be used as an indicator of organ motion. The sensor 36 may be connected to the 
respective sensor-based determination system 34 via one or more leads 38 which may 
10 transmit a signal representative of the sensed metric or parameter to the respective 

system 34 for processing. In some contexts, the sensor 36 may communicate with the 
respective sensor-based motion determination system 34 via wireless means, such as a 
wireless network protocol, as opposed to a physical lead 38. 

15 Sensor-based determination systems 34 may include electrical motion 

determination systems 40, such as systems that detect or measure electrical activity or 
characteristics of an organ to indicate motion. Electrical motion determination 
systems 40 may measure electrical activity indicative of the muscular contractions of 
an organ, such as an electrocardiogram (ECG). Electrical motion detection systems 

20 40 may also measure changes in electrical properties, such as impedance, which are 

indicative of organ motion, such as impedance plethysmography. The electrical 
sensors 42 used to detect electrical events, such as electrical contact pads, are typically 
strategically placed to detect the electrical attributes of the organ. For example, in the 
context of detecting and monitoring the motion of the heart, electrical events can be 

25 detected by a four-sensor ECG system, a twelve-sensor ECG system, a vector 

cardiography (VCG) type of arrangement, or by multiple ECG sensors arranged in 
array or matrix format to cover the region of interest. 

Sensor-based motion determination systems 34 may also include non-electrical 
30 motion determination systems 44, such as systems that detect and/or measure 

displacement, acceleration, velocity, pressure, and/or other mechanical indicators of 
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motion. Various types of mechanical sensors 46 may be employed to detect and/or 
measure the mechanical indicators of motion, including accelerometers, optical 
markers, displacement sensors, force sensors, ultrasonic sensors, strain gauges, 
photodiodes, and pressure sensors. 

The non-electrical events may be detected one or more mechanical sensors 46. 
In the case of multiple mechanical sensors 46, the mechanical sensors 46 may be 
arranged in an array or matrix format placed in or near the region of interest. Sensor 
arrays or configurations are possible in which the mechanical sensors 46 are arranged 
in a three-dimensional matrix such that the entire body surface in the region of interest 
is covered, such as by using a suit or wrap. Typically, in an array of mechanical 
sensors 46 used to measure non-electrical events, the mechanical sensors 46 are 
placed equidistant from each other. For instance, a 5 unit of separation may be 
maintained between the mechanical sensors 46 in the X, Y, and/or Z directions. 

In general, the mechanical sensors 46 of a non-electrical motion determination 
system 44 detect the mechanical, i.e., physical, motion of the organ or organs of 
interest via one or more of the means listed above. For example, internal movement, 
such as a heart beat or respiration, may create mechanical motion detectable by one or 
more mechanical sensors 46 disposed on the skin of the patient 14 as pressure, 
displacement, acceleration, and so forth. In this manner, internal motion of one or 
more internal organs may be detected, measured, and represented, either as a map of 
surface motion or as a map of internal motion. Such a map of surface or internal 
motion may be combined with other sensor or image data to generate a fusion image 
representing the various measured characteristics, such as structure, acceleration 
displacement, and/or electrical activity. 

Image-based and sensor-based motion detection and measurement using the 
various systems and components of Fig. 1, is described in detail with reference to Fig. 
2. Detection and/or measurement of the motion of one or more organs may occur via 
a variety of processes and at different times prior to, during or after the imaging 
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process. In particular, image-based detection and/or measurement of organ motion, as 
depicted by block 50, and/or sensor-based detection and/or measurement of organ 
motion, as depicted at block 52, may occur at suitable times within the process. Due 
to this time independence, the various motion measurement and/or detection 
5 techniques may be performed in a variety of orders or concurrently, depending on the 

constraints of the technique, with the resulting motion data representing the data 
available at any given time. For example, within the category of image-based 
techniques 50, motion may be detected and/or measured by using pre-acquisition 
motion data 54, as determined at block 56, and/or by using acquisition motion data 58, 
10 as determined at block 60. 



Examples of pre-acquisition techniques for detecting or measuring motion of 
one or more organs, as depicted at step 56, include the use of navigator echoes in 
MRI, the use of scout images in CT, and the use of fluoroscopic images in other X-ray 

15 contexts. Pre-acquisition motion detection and measurement typically involves 

determining the position of the organ or organs of interest by a pre-acquisition 
measurement using the imaging system 10. Subsequent image acquisition can then 
occur during similar states of organ motion or subsequently acquired image data may 
be selected for processing and reconstruction based upon a similar state of organ 

20 motion. 



For example, in MRI, a navigator echo pulse is a quick MR pre-pulse sequence 
that measures the position of an organ, such as the diaphragm, before primary image 
data acquisition. The pre-pulse sequence images a narrow area perpendicular to the 

25 movement of the organ of interest, i.e., a vertical area for a diaphragm. The contrast 

of the moving interface is typically high to permit easy automatic detection. Once the 
pre-acquisition motion data 54 has been acquired, the position of the interface may be 
recorded and imaging data may be acquired or selected based on whether the position 
of the interface falls within a range of pre-specified values determined from the pre- 

30 acquisition data 54. Using the navigator echo data, similar respiratory rates or other 

motion states of the patient can be identified and used for motion estimation. Hence, 
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the navigator echo technique may be used as a respiratory gating technique that does 
not utilize additional sensing equipment, as the MR system itself provides the sensing. 

Similarly, acquisition motion data 58, such as organ motion information 
5 derived from the acquired and/or reconstructed image domains, may be used to 

determine the motion of one or more organs. The acquisition motion data 58 may be 
determined from one-dimensional, two-dimensional, or three-dimensional 
representations of the imaged region derived from the image data. For example, organ 
motion may be determined in the acquired image domain after a segmentation or 
10 structure identification step. Changes in the location of the segmented structure or 

region may be determined in sequential image date and equate to the motion of the 
organ or organs. In this manner, acquisition motion data 58 may be used to determine 
motion for one or more organs in the field of view of the imager 12. 

15 Likewise, within the category of sensor-based techniques 52, motion of one or 

more organs may be determined using electrical motion data 62, as determined at 
block 64, and/or by using non-electrical motion data 66, as determined at block 68. 
The electrical motion data 62 may include ECG data if the heart is an organ of 
interest, or impedance plethysmography data if the lungs are an organ of interest. 

20 Electrical signals or properties of other organs of interest may also comprise the 

electrical motion data provided suitable electrical sensors 42 are disposed on the 
patient 14. 

In regard to non-electrical motion data 66, the motion of virtually any organ 
25 may generate mechanical or physical indicia that may be detected or measured by 

suitable mechanical sensors 46 disposed on the skin of the patient 14. For example, 
accelerometers may comprise the mechanical sensors 46 for measuring acceleration, 
and the respective displacement, resulting from the motion of an internal organ, such 
as the heart, lungs, stomach, liver, pancreas, and so on. Similarly, ultrasonic sensors, 
30 optical markers, strain gauges, and so forth may be deployed as mechanical sensors 46 
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suitable for measuring acceleration, displacement, velocity, pressure, and other non- 
electrical motion data 62 associated with one or more organs. 

The aggregate motion data 70, i.e., the motion data for each organ for which 
5 motion was detected or measured and/or for each motion sensing methodology 

employed, contains the multi-input motion data 72 of interest for the imaging process. 
Aspects of the aggregate motion data 70 may be combined and/or separated for each 
organ of interest or for the different motion sensing methodologies, as depicted at 
block 74, to derive the multi-input motion data 72 relevant for the organs or organs of 

10 interest at a given time or point in the process. The combination and/or separation 

procedure depicted may depend on the number of organs of interest, the techniques 
employed to measure motion, the coverage area of the imaging modality, the 
processing techniques to be employed, i.e., prospective and/or retrospective, and so 
forth. For example, where the motion of an organ is measured or detected by multiple 

15 motion sensing methodologies, the motion information may be combined to derive a 

more accurate motion characterization of the organ at a given time. Similarly, where a 
motion sensing methodology detects the motion of more than one organ, the 
information associated with each organ may be separated to better characterize the 
motion of the individual organs at a given time. The result of the combination and/or 

20 separation procedure 74 is one or more sets of multi-input motion data 72 which may 

be used for motion compensation in respective images and/or may be subsequently 
analyzed to obtain prospective or retrospective gating intervals for image acquisition 
and processing. 

25 In this manner, the multi-input motion data 72 may comprise motion data for 

the organ of interest derived from multiple sources, such as sensor-based or image- 
data based sources. The multi-input motion data may also comprise motion data for 
proximate organs, which contribute to the overall motion of the organ of interest, 
derived from one or more sources, including possibly a source used to measure the 

30 motion of the organ of interest. The multi-input nature of the multi-input motion data, 

therefore, may encompass either the presence of motion data for more than one organ, 
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the presence of multiple sources of motion data for an organ, or the presence of both 
multi-organ and multi-source motion data. 

Furthermore, positional information may be taken into account, such as during 
data acquisition, combination and/or separation, or during subsequent processing, to 
generate the multi-input motion data 72. For example, an initial determination may be 
made whether the coverage area of the sensors 36 or of the imager 12 is sufficient to 
cover the desired region of interest. If the coverage area is sufficient, motion 
detection and/or measurement and image processing may proceed as discussed above. 

However, if the coverage area is insufficient, such as when scans or images are 
being taken of the torso from the neck to the abdomen or of the whole body, positional 
sensors may be employed. The positional sensors may provide information 
concerning the region being currently scanned so that other data acquisition activities 
may be activated or deactivated accordingly. For example, when positional sensors 
are employed, the sensors 36 in the area being scanned by the imager 12 may be 
activated while sensors 36 outside of the scanned area may remain inactive. In this 
manner, unnecessary or redundant data is not acquired. As one of ordinary skill in the 
art will appreciate, the number of positional sensors may vary depending on the 
application. Alternatively, the sensors 36 may all be active during the image data 
acquisition. The positional information obtained by the positional sensors, however, 
may be employed during the combination and/or separation step 74, or during 
subsequent processes, to discard unnecessary image or motion data or to otherwise 
account for the positional information during imaging. 

An example of a set of multi-input motion data 72 is depicted in Fig. 3. As 
depicted in Fig. 3, the multi-input motion data 72 includes three waveforms, two 
cardiac motion waveforms 80 and a pulmonary motion waveform 82. The cardiac 
waveforms include an ECG 84 and a mechanical cardiogram (MCG) 86, such as may 
be derived using one or more mechanical sensors 46 disposed on the skin that measure 
cardiac acceleration and/or displacement. The pulmonary motion waveform 82 may 
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be derived by electrical means, such as impedance plethysmography, or by non- 
electrical means, such as by the acceleration or displacement measured by one or more 
mechanical sensors 46. Indeed, the same mechanical sensors 46 may be used to 
measure both heart and lung motion with the motion data associated with each organ 
being separated to form the multi-input motion data 72. 

In the context of gating techniques, the multi-input motion data 72 may be 
processed to extract one or more quiescent periods 88 for the one or more organs of 
interest, as depicted at step 90 of Fig. 4. Referring once again to Fig. 3, this extraction 
process can be visualized with reference to the cardiac waveforms 80 and the 
pulmonary waveform 82. For example, referring to the ECG waveform 84, an interval 
of minimal motion 92 can be distinguished from the ECG 84 between the T wave and 
the subsequent P wave. Similarly, an interval of minimal motion 94 can be 
distinguished from the MCG 86 roughly coincident with the interval 92 determined 
from the ECG 84. A cardiac interval of minimal motion 96 which reflects the interval 
common to the ECG interval 92 and the MCG interval 94 can thereby be derived from 
the cardiac waveforms 80. Similarly, a pulmonary interval of minimal motion 98 can 
be derived from the pulmonary waveform 82. 

A quiescent period 88 that reflects the interval common to the cardiac interval 
of minimal motion 96 and the pulmonary interval of minimal motion 98 may thereby 
be derived. In the context of the present example, the quiescent period 88 represents 
an interval of minimal motion for all of the organs represented by the multi-input 
motion data 72. As one of ordinary skill will appreciate, additional quiescent periods 
88 may be similarly derived. Furthermore, additional motion data for these organs 
and/or for other or additional organs may be included within the multi-input motion 
data 72. In particular, the generation and/or processing of the multi-input motion data 
set 72, such as in the separation/combination step 78 and/or in the extraction step 90, 
can be performed for each individual organ separately, in series, in parallel, or in any 
order for use in subsequent processes and analyses. 
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As a validation step or as an additional step in the process, the organ motion 
from a second source, such as from motion computed in either one-dimension or two- 
dimensions from the unreconstructed or reconstructed acquisition image data may be 
used for validation. In this manner, organ motion derived from the acquisition image 
5 data can be synergistically used to determine one or more quiescent periods 88 or to 

validate the quiescent periods 88 determined by sensor-based and/or pre-acquisition 
image data-based techniques, as depicted at decision block 100. In addition, the one 
or more quiescent periods 88 may be tested for validity based on organ specific 
knowledge 102 pertaining to the one or more organs of interest, such as may be 

10 obtained from a general physiological reference work or database, or based on patient 

specific factors, such as patient history. If the quiescent period 88 is determined not to 
be valid based on the image-based motion information and/or the organ or patient 
specific knowledge, an operator may be alerted that no quiescent period 88 can be 
extracted, as depicted at block 104, and acquisition or processing may be terminated 

15 or modified. 

If the one or more quiescent periods 88 are determined to be valid, the 
validated quiescent periods 88 may be used to determine motion compensation factors 
106, as depicted at step 108. Determination of one or more motion compensation 

20 factors 106 may involve modeling the anticipated motion, based on the multi-input 

motion data 72 and/or quiescent periods 88, and calculating factors that compensate 
for the motion. Motion modeling can be accomplished either using the data directly 
or using a priori information about the moving organ. When motion is computed 
directly from the data, motion compensation factors 106 may be derived by an 

25 iterative algorithm trying to optimize criteria in multiple domains including the spatial 

and transform domains. When prior information is available, non-iterative methods 
can be used for determination of motion compensation factors 106. 

Gating points 110 may be derived from the validated quiescent periods 88 at 
30 step 108 instead of, or in addition to, motion compensation factors 106. The gating 

points 110 typically describe the points in time from which acquired data is selected, 
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for retrospective gating, or during which data acquisition occurs, for prospective 
gating. For example, referring to Fig. 3, gating points 110 may be selected which 
coincide with the beginning and end of the quiescent period 88 such that image data is 
acquired or selected at the beginning of the quiescent period 88 and is not selected or 
5 acquired after the end of the quiescent period 88. In this manner, image data is 

acquired or selected which corresponds to an interval of low or no motion for the 
organ of interest, such as the heart or lungs in this example. Reconstructed images of 
the organ or organs of interest, therefore, should be less susceptible to motion-related 
artifacts. 

10 

The gating points 110 and motion correction factors 106 derived from the 
multi-input motion data 72 may be utilized by various image-processing techniques. 
For example, prospective gating points, i.e., gating points 110 used for prospective 
gating, may be utilized during an image acquisition process, as depicted in Fig. 5. The 
15 prospective gating points may be derived from multi-input motion data processing, as 

depicted at step 114. 

The step 1 14 of multi-input motion data processing may include some or all of 
the steps and data described above with regard to Figs. 2 and 4 and may represent a 

20 dynamic step that reflects the acquisition of motion information by sensor and/or 

image data-based methodologies prior to and/or during the image acquisition interval. 
The resulting set of multi-input motion data 72 may be processed at the dynamic 
processing step 114 to extract the desired quiescent periods 88, gating points 110, 
and/or motion correction factors 106. For example, in the case of cardiac imaging, 

25 electrical sensors 42 may be employed to detect the motion of the heart and/or lungs 

during or prior to image acquisition, allowing the determination of or prediction of 
prospective gating points. Furthermore, one or more mechanical sensors 46, such as 
accelerometers or displacement sensors may be employed in addition to or instead of 
electrical sensors 42 to detect the motion of the heart and/or lungs during or prior to 

30 image acquisition. 
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Similarly, image data-based techniques, such as pre-acquisition techniques, 
may be employed in addition to or instead of the sensor-based techniques to detect the 
motion of one or more of the organs of interest during or prior to image acquisition. 
In addition, acquisition data, either in reconstructed and/or unreconstructed domains, 
5 may be used for extrapolating a cycle of motion or for validating a phase of motion 

that may be useful in a prospective context. The resulting set of multi-input motion 
data 72 may, therefore, be used to determine quiescent periods 88, as discussed above, 
which may in turn be used to derive gating points 110 for use in the prospective gating 
of the image data acquisition of the one or more organs of interest. 

10 

Referring once again to Fig. 5, the prospective gating points determined by the 
multi-input motion data processing step 114 may be used to activate an imager 12 to 
acquire data 118 during the desired quiescent periods 88, or other period of interest, as 
depicted at step 116. The acquired data 118 may be reconstructed to form a set of 

15 reconstructed data 120, as depicted at step 122. The reconstructed data 122 may be 

further processed if desired, such as by segmentation of structure or features of 
interest, edge enhancement, smoothing, and so forth. An image 124 of the region of 
interest which contains a reduced number of motion related artifacts may be 
generated, as depicted at step 126. In addition, motion compensation factors 106 may 

20 be derived from the quiescent periods 88, or other period of interest, which may be 

applied during data reconstruction at step 122 or image generation at step 126 to 
further reduce motion-related artifacts. Furthermore, image fusion may be 
implemented if multiple electrical and/or non-electrical sensors are employed, 
particularly in the context of multi-modality imaging. In such an image fusion 

25 context, motion data derived from the multi-input motion data set 72 may be 

combined with the image data in the image 124 to visually convey motion, 
acceleration, displacement, polarization, or some other sensed parameter in 
conjunction with structure. 

30 Alternatively, gating points 110 for use in a retrospective gating process may 

be derived from a multi-input motion data processing step, such as the step depicted at 
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block 132 of Fig. 6. The step 132 of multi-input motion data processing may include 
some or all of the steps and data described above with regard to Figs. 2 and 4 and may 
represent a dynamic step that reflects the acquisition of motion information by sensor 
and/or image data-based methodologies prior to and/or during the image acquisition 
5 interval. The resulting set of multi-input motion data 72 may be processed at the 

dynamic processing step 132 to extract the desired quiescent periods 88, gating points 
110, and/or motion correction factors 106. Unlike multi-input motion data processing 
associated with prospective processes, multi-input motion data processing associated 
with retrospective processing may rely more heavily on acquisition image data and 

10 need not rely on extrapolations or projected motion. For example, in the context of 

image data -based motion determination, image data from the acquired domain, the 
reconstructed domain, or both domains may be used retrospectively for determining 
one or more quiescent periods 88 from which motion correction factors 106 or gating 
points 110 may be derived. Similarly, sensor-based or pre-acquisition image data may 

15 be used to derive motion information for retrospective use when desired, as described 

with regard to prospective applications. In addition, locational information from one 
or more positional sensors may be used during the processing of the multi-input 
motion data 72 at step 132 or may be used during subsequent image processing and/or 
reconstruction steps. 

20 

For example, as depicted in Fig. 6, acquired data 134 may be acquired during a 
scan of the patient 14 by the imager 12, as depicted at step 136. Retrospective gating 
points derived from the multi-input motion data processing step 132 may be utilized 
to select a subset of the acquired data 134 in the acquired domain for processing, as 

25 depicted at step 138. The processing occurring at step 138 may include not only data 

selection based on the retrospective gating points, but also motion estimation, and/or 
data conditioning steps suitable for processing image data in the acquisition domain. 
Based on the retrospective gating points and the processing occurring at step 138, the 
acquired data 134 may be reconstructed, as depicted at step 140, to generate a set of 

30 reconstructed data 142. The reconstructed data 142 may be further processed if 

desired, such as by segmentation of structure or features of interest, edge 
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enhancement, smoothing, and so forth. An image 144 of the one or more organs of 
interest may be generated from the reconstructed data 142, as depicted at step 146. 
The step 146 of image generation and/or the step 140 of acquired data reconstruction 
may also include the application of motion compensation factors 1 06, such as may be 
determined during the processing step 138. In addition, the step 146 of image 
generation may include image fusion if multiple electrical and/or non-electrical 
sensors are employed, particularly in the context of multi-modality imaging. In such 
an image fusion context, motion data derived from the multi-input motion data set 72 
may be combined with the structure data in the image 144 to visually convey motion, 
acceleration, displacement, polarization, or some other sensed parameter in 
conjunction with structure. 

Data selection based on the reconstructive gating points may also occur in the 
reconstructed domain, such as at processing step 148. In addition to data selection, 
the processing step 148 may include motion estimation, segmentation, edge 
enhancement, and/or other routines applicable to the reconstructed domain. Based on 
the retrospective gating points and the processing occurring at step 148, the 
reconstructed data 142 may be used to generate one or more images 144 of the organ 
or organs of interest, as depicted at step 146. As noted above, the image 144 may 
incorporate motion compensation factors 106 and/or may result from an image fusion 
process. 

Furthermore, a one time or iterative transformation process, as depicted at step 
150, may be performed. The transformation step 150 transforms some or all of the 
reconstructed data 142 from the reconstructed domain back to the acquisition domain 
after some degree of processing and/or enhancement. For example, the reconstructed 
data 142 selected in accordance with the reconstructed gating points may be edge 
enhanced, sharpened, smoothed, and so forth, and then transformed back to the 
acquisition domain. Once in the acquisition domain, the transformed data may be 
reconstructed again into reconstructed data 142. The reconstructed data may be 
generated into an image 146 or iteratively processed and transformed until some 
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desired image quality is obtained or a set number of iterations is performed. Though 
all of the reconstructed data 142 selected in accordance with the retrospective gating 
points may be processed and transformed as described, a subset or superset of such 
data may instead be transformed in this manner. For example, if the processing step 
5 148 includes segmenting the reconstructed data 142 into features of interest, only that 

portion of the reconstructed data 142 corresponding to a feature and/or to a 
retrospective gating interval maybe transformed at step 150. 

As one of ordinary skill in the art will appreciate, the prospective and 
10 retrospective gating techniques discussed above may be combined, as depicted in Fig. 

7. In this prospective gating followed by retrospective gating technique, the step 154 
of multi-input motion data processing may generate gating points not only for 
prospective acquisition but also for retrospective processing. In addition, the multi- 
input motion data processing step 154 may generate motion compensation factors 106 
15 for use in the image generation process. The multi-input motion data processing step 

154 may include some or all of the steps and data described with regard to Figs. 2 and 
4, as noted in the discussion of the separate prospective and retrospective gating 
techniques. 

20 For example, referring to Fig. 7, the prospective gating points determined by 

the multi-input motion data processing step 154 may be used to activate an imager 12, 
as depicted at step 116, to acquire data 118 during the desired quiescent periods 88. 
Retrospective gating points derived from the multi-input motion data processing step 
154 may be utilized to select a subset of the acquired data 130 in the acquired domain 

25 for processing, as depicted at step 138 in Fig. 7. In practice, the prospective gating 

interval of the prospective followed by retrospective gating technique will typically be 
greater than the prospective gating interval defined when only prospective gating is 
employed. The acquired redundant data may be used for retrospective validation of 
gating points. In addition, the processing step 138 may also include motion 

30 estimation, and/or data conditioning steps suitable for processing image data in the 

acquisition domain. 
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Based on the selection and processing occurring at step 138, the acquired data 
may be reconstructed, as depicted at step 140, to generate a set of reconstructed data 
142. The reconstructed data 142 may be further processed if desired, such as by 
segmentation of structure or features of interest, edge enhancement, smoothing, and so 
forth. An image 144 of the one or more organs of interest may be generated from the 
reconstructed data 142, as depicted at step 146. The step 146 of image generation 
may also include the application of motion compensation factors 106, such as in 
response to motion estimation that may occur during the processing step 138. In 
addition, the step 146 of image generation may include image fusion, as discussed 
above, to visually incorporate motion, electrical, or other sensed data with the 
displayed structure data. 

Data selection based on the reconstructive gating points may also occur in the 
reconstructed domain, such as at processing step 148. The processing step 148 may 
include motion estimation, segmentation, edge enhancement, and/or other routines 
applicable to the reconstructed domain in addition to data selection. Based on the 
retrospective gating points and the processing occurring at step 148, the reconstructed 
data 142 may be used to generate one or more images 144 of the organ or organs of 
interest, as depicted at step 146. As previously noted, the image 144 may incorporate 
motion compensation factors 106 and/or may result from an image fusion process. In 
addition, a one time or iterative transformation process, as depicted at step 150, may 
also be performed, as discussed in greater detail with regard to Fig. 6. 

The prospective followed by retrospective technique described with regard to 
Fig. 7 may be modified to further reduce motion-related artifacts. This composite 
gating technique, as depicted in Fig. 8, may utilize pre-acquisition motion data 54, 
such as may be derived from a navigator echo, scout image, fluoroscopic image, and 
so forth. In particular, subsequent to retrospective data selection and any desired data 
processing performed at step 138, the processed data may be further compensated for 
motion of the one or more organs of interest, as depicted at step 158. The motion 
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compensation step 158 may utilize the pre-acquisition data 54 or motion data from 
other sources, such as the multi-input motion data 72. The modified data may be 
reconstructed at step 140 to generate a set of reconstructed data 142 which may be 
generated into an image 144 of the organ or organs of interest at step 146. 

As noted above, however, data selection based on the reconstructive gating 
points may also occur in the reconstructed domain, such as at the processing step 148. 
As discussed above, a one time or iterative transformation process, as depicted at step 
150, may also be performed with the resulting acquisition domain image data being 
reconstructed back to the reconstruction domain at step 140. Subsequent to the 
processing of the reconstruction domain image data at step 148, the processed image 
data may be further compensated for the motion of the one or more organs of interest 
at step 158. As noted above, the pre-acquisition data 54 or other available motion 
data may be used in the motion compensation. The motion compensated data may be 
used to generate an image 144 of the one or more organs of interest, as depicted at 
step 146, or may be transformed at step 150 in accordance with the prior discussion 
regarding transformation. As noted above, the transformation process may occur once 
or may be iterated a set number of times or until image quality converges or exceeds 
some threshold value. 

While the invention may be susceptible to various modifications and 
alternative forms, specific embodiments have been shown by way of example in the 
drawings and have been described in detail herein. However, it should be understood 
that the invention is not intended to be limited to the particular forms disclosed. 
Rather, the invention is to cover all modifications, equivalents, and alternatives falling 
within the spirit and scope of the invention as defined by the following appended 
claims. 
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